SYSTEM AND METHOD FOR IMAGE PROCESSING 



RELATED APPLICATION 
This application claims the benefit of Provisional Application, U.S. 
Serial No. 60/184,088, filed on February 22, 2000, entitled "SUPER JPEG BUILDER 
AND METHOD FOR IMAGE ENHANCEMENT 55 , by Kenneth Richards, Thomas 
Ramsay, and Michael Wackerfuss. 

TECHNICAL FIELD 
The present invention relates to image processing, more particularly, to 
an image processing system and method for automatically processing images without 
operator's intervention. 

BACKGROUND OF THE INVENTION 
Considerable research and development have been conducted over the 
past few years in image processing fields, for example, image compression to reduce an 
image file size, or image enhancement to improve an image quality, etc. 

Typically, image data are large in size and often required to be 
compressed to a smaller size before they are stored and/or transmitted in media. 
Various methods have been developed to compress an image file. For example, in U.S. 
Patent No. 5,426,5 12, a method of digital compression of images is disclosed. The 
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patented method uses a DCT transform coefficients yielded from a Discrete Cosine 
Transform (DCT) of all the blocks as well as other display and perceptual parameters to 
generate a quantization matrix which in turn yields a reproduced image having a low 
perceptual error. The patented method adapts or customizes the individual quantization 
5 matrix to the image being compressed. 

One of the problems associated with existing image compression 
methods is that these compression methods do not apply any pre-compression filtering 
to reduce image quality degradation as the compression is applied, e.g. sharpening of 
images, removing artifacts, etc. Under a high compression setting, an image generally 

10 loses its image characteristics/attributes. Further, compression of images introduces 
artifacts. These methods of compression do not take into account for preparing the 
image prior to compression to reduce the visible artifacts so as to maximize the 
compression applied and retain visual qualities. Images that have been 1) previously 
compressed with an algorithm, for example, JPEG (Joint Photographic Expert Group); 

15 2) having a dot pattern from being scanned; 3) GIF images that have dots because of 
their dithering or color pallet being limited to some number of colors, have varying 
degrees of artifacts dependent upon the compression applied. 

Some existing image processing systems apply enhancement to original 
and previously compressed images to enhance the image quality. When automated, the 

20 same enhancement parameters are applied to all images of the batch process such as 
contrast or brightness without taking into account for the individual qualities of each 
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image to be enhanced. Thus, these existing image enhancement systems may not 
enhance a batch processed image, but degrade the quality and/or visual characteristics of 
the image as viewed by a human. In addition, artifacts problems still remain. 



5 systems is that the image processing requires an operator's intervention. Typically, an 
operator randomly chooses image processing parameters, such as sharpness, contrast 
percentage, etc., enhances an image based on the chosen parameters, and judges whether 
the enhanced image is acceptable. If not, different image processing parameters are 
chosen to enhance an original image. This process is time consuming. This process is 

10 more or less depending on operator's experience. U.S. Patent No. 5,694,484 has 

addressed these concerns and attempts to solve the problem. However, the system still 
requires an operator's intervention, even though it is minimized. For example, an 
operator needs to select image processing operations to process an input image. 
Further, as mentioned above, like many other existing image enhancement systems, this 

1 5 patented system does not enhance an image to a point that the image has quality and/or 
visual characteristics as viewed by a human and does not pre-process the image prior to 
compression so as to reduce image quality degradation or artifacts introduced by the 
compression method and thus allow a greater degree of compression to be applied while 
retaining visual qualities. 

20 Furthermore, existing enhancement and compression methods do not 

take into account for image quality such as sharpness as the size of the image is reduced. 



Another problem that resides in conventional image enhancement 
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This is particularly true with thumbnail images where the amount of information that 
defines the image and its characteristics are very small. Thus, small images, such as 
thumbnails, have poor visual quality. 

A further problem of conventional image enhancement systems is that an 
5 input image must be loaded into a memory repeatedly for each multiple output desired. 
This slows down the processing time and wastes many resources. 

It is with respect to these and other considerations that the present 
invention has been made. 
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SUMMARY OF THE INVENTION 
In accordance with this invention, the above and other problems were 
solved by providing an image processing system and method capable of automatically 
analyzing, classifying, enhancing, pre-compression processing, and compressing each of 
5 a series of input images on-the-fly without operator's intervention in a wire and/or 
wireless transmission environment or embedded in a hardware, software, or firmware 
device, and outputting one or more enhanced images without re-analyzing, re- 
classifying, and re-enhancing the input image. 

The present invention provides an image processing system and method 
10 which automatically generates one or more highest quality images in given file sizes. 
Also, the present invention provides a system capable of processing a series of input 
images in a batch mode or in real time on-the-fly. Accordingly, the system in 
accordance with the principles of the present invention can function as a round-the- 
clock "professional image processing specialist" with speed and skill levels unmatched 
1 5 by any human counterpart. 

Further, the present invention provides a system and method which 
greatly improve high-contrast or over- or under-exposed pictures, images generated 
from document scanners or digital cameras, etc. 

Furthermore, the present invention provides an image processing system 
20 and method for generating enhanced and/or compressed images having a high 
compression to quality ratio, such as a JPEG image, and enhanced uncompressed 
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images, such as a BMP (Bitmap) or TIFF (.tif) image. For example, the system 
produces an image having quality and visual characteristics as viewed by a human 
including image brightness, contrast, and sharpness as compared with an original 
uncompressed image, while reducing the amount of memory required for storing the 
5 file. 

In one embodiment of the present invention, each input image is 
analyzed for its unique luminosity and/or color characteristics/attributes, classified, and 
enhanced to improve its visual qualities. The method includes automatically analyzing 
a luminosity histogram associated with a particular image and deriving at least three 

10 statistical functions for the luminosity histogram, the statistical functions include a 

Weighted Mean (WM) function, a Half Value Position (HVP) function, and a Weighted 
Standard Deviation (WSD) function; and automatically classifying the image by its 
statistical functions, which are compared against set parameters for each class of images 
that are derived from experimental data stored in tables or a database structure. The 

15 experimental data can be a collection of human experienced/perceptive data about 

images from which tables or a knowledge based database is built. The method further 
includes automatically applying a predetermined set of changes to the image based upon 
its class. 

The system and method in accordance with the present invention further 
20 include all interfaces and logics capable of operating in real time and static 

environments as part of an application or as a stand-alone utility, for example, on a 
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stand-alone computer, a server-based network, or the Internet, etc. The interfaces 
provide control of an operator defined quality and compression settings which can be 
defined on an individual image basis or specified as a rule set for all images processed 
until such time as another rule set is applied. These settings define the methodology for 
5 analysis of the file type to achieve the compression to quality ratio specified. In 
addition, the system and method are capable of performing pre-image compression 
enhancement for any known or future compression algorithm, such as JPEG, Wavelet, 
Fractal, etc. This is also made possible for outputting an enhanced uncompressed image 
file type, such as BMP or TIFF, etc. 

10 The present invention also addresses the issues of artifacts introduced 

into images due to the source or previous processing of the image. The artifacts are 
reduced by applying filters, such as a "Blur" filter that tends to "smear/smudge" the 
blocking generated as a result of compression or similar to a blocking of dot patterns 
created by scanned images or GIF. The "Blur" filter reduces the appearance of the 

15 blocking throughout the whole picture. The blocking artifacts and the picture details are 
both blurred. However, the edges that define the original picture content can be restored 
by applying multiple iterations of the unsharp mask filter in varying amounts (e.g. 
15%/15%/15%) whereupon the edges are slowly redefined. Furthermore, the pixel size 
of the image may determine the amount of unsharp mask applied. 

20 Furthermore, in an automated environment where diverse image sizes 

and quality need to be enhanced and/or compressed or recompressed, a ratio of file size 
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in bytes to the total pixel count of an image can be used as a measuring parameter to 
determine an optimal compression factor so as to retain good visual qualities and 
achieve a higher degree of compression than that of an original compressed image, e.g. 
a JPEG, This allows an image processing system to approximate a quality based upon 
the image's ratio. 

In one embodiment, the present invention provides a method of 
automatically processing a series of input images without operator's intervention. In 
automatically processing each of the input images, the method includes the steps of 
providing processing parameters; automatically analyzing, classifying, and enhancing 
each of the input images without operator's intervention; and outputting at least one 
enhanced image. 

Still in one embodiment, the method outputs more than one enhanced 
images without re-analyzing, re-classifying, and re-enhancing the input image. The 
enhanced output images may be in different file types and/or sizes. 

Further in one embodiment, the images can be processed in real time on- 
the-fly or in a batch mode. Further, the images can be processed in a hardware, 
firmware, or software embodiment that furthermore can be embedded in another system, 
device, and/or application. 

Yet in one embodiment, the method may include one or more of the 
steps of: pre-processing the input image; automatically resizing the enhanced image; 
automatically pre-compression enhancing the enhanced image; post-processing the 
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enhanced image; and automatically compressing the enhanced image. 

The present invention also provides a method of automatically 
processing a series of input images without operators intervention. In automatically 
processing each of the input images, the method includes the steps of providing 
5 processing parameters; automatically analyzing and classifying the input image without 
operator's intervention; automatically compressing the image; and outputting at least 
one compressed image. 

Still in one embodiment, the method outputs more than one compressed 
image without re-analyzing and re-classifying the input image. The compressed output 
10 images may be in different file types and/or sizes, and/or of different compression 
ratios, YUV settings, and Q-factor. 

Further in one embodiment, the images can be processed in real time on- 
the-fly or in a batch mode. Further, the images can be processed in an embedded 
hardware, firmware, or software that can be embedded in another application. 
1 5 Yet in one embodiment, the method may include one or more of the 

steps of: pre-processing the input image; resizing the compressed image; pre- 
compression enhancing the compressed image, post-processing the compressed image; 
and compressing the compressed image. 



20 automatically processing a series of input images without operator's intervention. In 
one embodiment, the system includes an input module for inputting a set of parameters; 



The present invention further provides an image processing system of 
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an image analysis module for automatically analyzing each of the input images, an 
image classification module for automatically classifying the analyzed image, an image 
enhancement module for automatically enhancing the classified image based on 
classification, and an output module for outputting at least one enhanced image. 
5 Still in one embodiment, the output module outputs enhanced images 

with different file types and/or sizes without re-analyzing, re-classifying, and re- 
enhancing the input image. 

Further in one embodiment, the image processing system processes the 
images in real time on-the-fly or in a batch mode. 

10 Additionally in one embodiment, the image processing system can be 

embedded in a hardware, firmware, or software which can be embedded in another 
system or application. 

Yet in one embodiment, the system may include one or more of the 
following: a pre-processor for pre-processing the input image; a resizer for resizing the 

15 enhanced image; a pre-compression enhancement module for pre-compression 
enhancing the enhanced image; a post-processor for post-processing the enhanced 
image; and a compression module for automatically compressing the enhanced image. 

Additionally in one embodiment, the image analysis module analyzes the 
image based on an image histogram. 

20 Still in one embodiment, the image classification module classifies the 

image based on the Weighted Means range, the Weighted Standard Deviation range, 
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and the Halve Value Position range of an image luminosity histogram. 

Further in one embodiment, the image enhancement module may include 
a brightness filter, a contrast filter; a saturation filter; a curve filter; an unsharp mask 
filter, a blur filter, and/or a hue filter, etc. 
5 Yet in one embodiment, the image compression module includes a JPEG 

compression. 

Still in one embodiment, the image resizer resizes the original input 
image to any smaller size image proportionately to the original image using any 
specified axis. 

1 0 Further in one embodiment, the image resizer resizes the image to a 

thumbnail size. 

Additionally in one embodiment, the image pre-processor includes a 
brightness filter, a contrast filter, a saturation filter, and/or an unsharp mask filter. 

Further in one embodiment, the image post-processor includes a 
1 5 brightness filter, a contrast filter, a saturation filter, and/or an unsharp mask filter. 

One aspect of the present invention is that the automatic image 
processing operations can be manipulated by an operator. For example, an operator can 
interrupt the automatic image processing operations at any time. The images in the 
process can be saved in a memory and later restored to continue the operations. For 
20 example, if an operator wants to check the quality of the process and/or the quality of a 
specific image, the images being processed in the operations are saved automatically. 
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A further aspect of the present invention is that the system and method 



provide an interactive interface between the system and an operator. For example, the 
present invention may generate an enhanced image on-the-fly or in real time to allow an 
operator or user to preview the enhanced image before the system outputs the enhanced 
5 image in a given size. 

For a better understanding of the invention, reference should be made to 
the drawings, which form a further part hereof, and to accompanying descriptive matter 
in which there are illustrated and described specific examples in accordance with the 
invention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Referring now to the drawings in which like reference numbers represent 
corresponding parts throughout: 

Fig. 1 illustrates one embodiment of an image processing system in 
5 accordance with the principles of the present invention. 

Fig. 2 illustrates one embodiment of an image processing system having 
additional optional modules in accordance with the principles of the present invention. 

Fig. 3 illustrates another embodiment of an image processing system in 
accordance with the principles of the present invention. 
10 Fig. 4 illustrates another embodiment of an image processing system 

having additional optional modules in accordance with the principles of the present 
invention. 

Figs. 5 A-5B illustrate a flow chart diagram of one embodiment of an 
image processing method in accordance with the principles of the present invention. 
1 5 Figs, 6A-6C illustrate a flow chart diagram of image 

classification/enhancement operations in one embodiment of an image processing 
method in accordance with the principles of the present invention. 

Figs. 7A-7C are exemplary curves applied to an image in an image 
enhancement operation in accordance with the principles of the present invention. 

20 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
In the following description of the illustrated embodiments, reference is 
made to the accompanying drawings which form a part hereof, and in which is shown 
by way of illustration several embodiments in which the invention may be practiced. It 
5 is to be understood that other embodiments may be utilized as structural or operational 
changes and may be made without departing from the spirit and scope of the present 
invention. 

Fig. 1 illustrates one embodiment of an image processing system 100 in 
accordance with the principles of the present invention. The image processing system 

10 100 includes an image analysis module 102, an image classification module 104, and 
an image enhancement module 1 06 wherein each image is automatically analyzed, 
classified, and enhanced individually based upon each of the characteristics without 
human intervention when multiple images are submitted for processing. It is noted that 
the image processing system 100 is capable of processing a single image as well as a 

15 series of images. 

As shown in Fig. 1, an image or a series of images are input into the 
image processing system 100. A set of processing parameters are used in the image 
processing system 100. The processing parameters may include predefined system, 
device, or operating environment parameters. The predefined system, device, or 

20 operating environment parameters may be determined by system resources and 

transmission bandwidth available or applications that the system is transmitted to or 
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embedded therein, etc. The processing parameters may also include user input 
parameters. For example, the processing parameters may include the number of output 
images, the size of the output image that a user desires, and/or a set of image output 
quality and compression settings, etc. The settings can be made on an individual image 
5 basis or specified in a rule set for all images processed until such time as another rule 
set is applied. The settings may define the methodology for analysis of a file type to 
achieve the image compression to quality ratio desired. Further, if a user chooses not to 
define its own settings, a set of default settings may be used. 

The input images may be processed in the image processing system 100 
10 in real time on-the-fly or in a batch mode. The image processing system 100 in 
accordance with the present invention may also be applied to environments such as 
web-crawling, a program that searches web pages hosted on the Internet to extract 
images for purpose of enhancing and further compressing of the images in an automated 
environment. 

1 5 Additionally in one embodiment, the image processing system can be 

embedded in a hardware, firmware, or software which can be embedded in another 

system or application. 

Further, the system 100 may be applied in an automated on-the-fly 

environment for re-purposing and further compressing of images. The re-purposing and 
20 further compressing of image allows for transmission of images to diverse devices 

having different rendering capacity and image type requirements and further reduction 
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of the bandwidth required for transmission of the images and the time required to 
download the images. The process may be applied to fixed wire or wireless 
transmission of images to devices. One example is that the system applies to images 
hosted on the Internet where an image content of an HTML page is further compressed 
5 and possibly re-purposed as a black and white image to fit the rendering requirements of 
a device. 



environment where images are sent to an imaging server via the Internet whereupon the 
images are processed directly upon receipt or from a temporary storage, stored for 
10 retrieval, and/or transmitted to the point of origin or some other defined location. In 
addition, the system may be applied in an automated on-the-fly or static environment 
where an image of a rendered HTML page is captured, enhanced, compressed, and/or 
stored and/or transmitted. 



1 5 histogram associated with a particular image and derives the Weighted Mean (WM), 
Half Value Position (HVP), and Weighted Standard Deviation (WSD) of the image 
luminosity histogram. The analyzed image is classified by the image classification 
module 104 and enhanced by the image enhancement module 106 based on the 
classification. 

20 In Fig. 2, the image processing system 100 may include an image input 

module 108, a pre-processor 1 10, a resizer 1 12, a pre-compression enhancement module 



Further, the system may be applied in an automated on-the-fly 



In Fig. 1, the image analysis module 102 analyzes a luminosity 
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1 14, a post-processor 1 16, a compression module 1 1 8 5 and an output module 120. For 
example, the resizer 1 12 may resize an enhanced image to a file size defined by a user, 
for example, to a thumbnail size (e.g. the longest axis of an image having less than 128 
pixels). In another example, the image compression module 1 1 8 may include a JPEG 
5 compression algorithm to compress an image if desired by the user. It is appreciated 
that these additional modules may be optional, and that the system 100 is not limited to 
these optional modules. 

The pre-processor 1 1 0 and the post-processor 116 may include a set of 
filters, but not limited to, for adjusting the brightness, contrast, and/or saturation, or 

1 0 applying unsharp mask to the image to enhance the image quality of the processed 

image. It is noted that the terms for brightness, contrast, saturation, and unsharp mask 
are known in the image processing art. 

The input module 108 sets or preserves a white threshold for an input 
image and determines whether an input image file has a file extension of jpg, .bmp, or 

1 5 .tif, etc. The input module 108 may also load the input image into a memory in a 

standard format, for example, a Device Independent Bitmap (DIB) format. The input 
module 108 determines image attributes, such as file type, file size, file dimension, etc., 
and obtains an image histogram, such as an image luminosity histogram to calculate the 
Weighted Mean (WM), Half Value Position (HVP), and Weighted Standard Deviation 

20 (WSD) of an image. 

The output module 120 may save the output image to a storage medium, 
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transmit the output image to a local or remote device, or pass the output image to 
another application, etc. If more than one images are desired to be outputted— for 
example, a user desires to have a first enhanced image to be of a regular size and a 
second enhanced image to be of a thumbnail size—, the system 100 automatically 
5 generates the second output image based on the user defined file size after generating 
the first output image. The system 100 does not need to re-load into memory, re- 
analyze, re-classify, or re-enhance the original input image. The system 100 processes 
the additional output images based on the user defined parameters for the additional 
output images for example resizing, pre-compression enhancement, pre- and post- 

10 processing, output file type, and compression after the enhancement module 106. 

Further, since the image input, the image analysis, image classification, 
image enhancement, and the image output can be separable, the system 100 is able to 
automatically process the subsequent input image in the image analysis module 102, 
image classification module 104, and image enhancement module 106 while outputting 

1 5 previously enhanced images. 

In one embodiment of the present invention, the image analysis module 
102 analyzes the input image to determine its unique characteristics, for example, color, 
black/white (B/W) ? gray scale, luminosity, contrast, brightness, curve, etc. The 
analyzed data may be stored in tables, a knowledge based database, or the like. 

20 In one embodiment of the present invention, the image classification 

module 104 classifies the input image based upon the Weighted Mean (WM), Half 
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Value Position (HVP), and Weighted Standard Deviation (WSD) of the image 
luminosity histogram. The WM, HVP, and WSD are compared to a predetermined set 
of parameters for each class of images that are derived from experimental data stored in 
tables, a knowledge based database, or the like. The experimental data can be a 
5 collection of human experienced/perceptive data about images from which tables or a 
knowledge based is built. Then, a predetermined set of changes may be applied to the 
image based upon its class. 

In one embodiment of the present invention, the image enhancement 
module 106 provides filters and masks to change the characteristics of the input image 

10 such that the image is improved and enhanced for its visual qualities. 

In one embodiment of the present invention, the image processing 
system 100 provides a user interface which allows a user to define an end-product 
image characteristics, for example, the highest compression, the best compression to 
quality ratio, a specific or near loss-less image characteristic, etc. 

15 Fig. 3 illustrates another embodiment of the image processing system 

122 in accordance with the principles of the present invention. The system 122 includes 
the analysis module 102, the classification module 104, and a compression module 124. 
The image is compressed by the compression module 124. 

In Fig. 4, the system 122 may further include the image input module 

20 108, the pre-processor 110, the resizer 112, the pre-compression enhancement module 
114, the post-processor 116, the compression module 118, and the output module 120. 
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It is appreciated that these additional modules may be optional, and that the system 122 
is not limited to these optional modules. 

Figs. 5 A-5B illustrate a flow chart diagram of one embodiment of an 
image processing method in accordance with the principles of the present invention. 
5 As shown in Fig. 5 A, an image processing operation flow 126 starts with 

an operation of setting a preserve white threshold for an input image in an operation 
128. In one embodiment, the preserve white threshold may be set to 253-255 out of a 
gray scale of 0-255. Accordingly, for the portions which have the gray scale of 253 or 
more, the white is preserved in the subsequent image processing. It is appreciated that a 

1 0 border can be adjusted and/or preserved with a certain gray scale within the scope of the 
present invention. Then, the operation flow 126 determines whether the input image is 
a compressed image, such as a JPEG image or an uncompressed image, such as a BMP 
or TIFF, in an operation 130. In one implementation shown in Fig. 5 A, if the input 
image is not a JPEG, BMP, or TIFF file, the operation flow 126 may be terminated. It 

15 is appreciated that the implementation can be varied such that other types of compressed 
or uncompressed images can be processed without departing from the scope of the 
present invention. 

In Fig. 5A, if the input image is a JPEG, BMP, or TIFF, the image is 
loaded into a memory or buffer in a standard format, such as a DIB format, in an 

20 operation 132. Then, the image attributes, such as file type, file size, and file 

dimension, are determined in an operation 134 by determining the characteristics of a 
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physical file. It is appreciated that the file type, file size, and file dimension 
determination is known in the art and not the focus of the present invention. Next, an 
image luminosity histogram of the input image is generated in an operation 136. The 
image luminosity histogram may include Weighted Mean (WM), Weighted Standard 
5 Deviation (WSD), and Half Value Position (HVP). The details of the WM, WSD, and 
HVP are described later in details. It is appreciated that the other types of image 
histograms can be used without departing from the scope of the present invention. 

Still in Fig. 5 A, the operation flow 126 determines whether a user desires 
to pre-process the input image in an operation 138. If "Yes", the brightness, contrast, 

10 and saturation percentage of the image may be adjusted based on the user definition in 
operations 140, 142, and 144, respectively. Further, an unsharp mask may be applied to 
the image, for example applying a mask percentage of a radius equal to 1 and a 
threshold equal to 1 in an operation 146. The pre-processing mask percentage can also 
be defined by the user. It is appreciated that the sequence or order of the operations 

1 5 140-146 can be varied within the scope of the present invention. 

If the image pre-processing is not desired in the operation 138, i.e. "No", 
the image is analyzed/classified based on the image histogram statistics in an operation 
148. The detailed analysis/classification is described later in Figs. 6A-6C. 

Then, the operation flow 126 determines whether an image enhancement 

20 is desired in an operation 150. If "Yes", a curve is applied based on analysis of the 
image histogram statistics in an operation 152. Further, the percentage of brightness, 
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contrast, and saturation of the image is adjusted based on the analysis of the image 
histogram statistics in operations 154, 156, and 158, respectively. It is appreciated that 
the sequence or order of the operations 152-158 can be varied within the scope of the 
present invention. Then, the operation flow 126 goes to Fig. 5B. On the other hand, if 
5 the image enhancement is not desired in the operation 150, i.e. "No", then the operations 
152-158 are bypassed, and the operation flow 126 goes to Fig. 5B directly. 

In Fig. 5B, the operation flow 126 determines whether the user desires to 
resize the image in an operation 160. If "Yes", the image is resized along its X axis, Y 
axis, or the longest axis in an operation 162. Then, the operation flow 126 determines 

10 whether the resized image is a thumbnail size image (e.g. the longest axis of the image 
having less than 128 pixels) in an operation 164. If the resized image is a thumbnail 
image, i.e. "Yes", the brightness of the image is adjusted by a predefined percentage, 
such as 2%, etc. in an operation 166, and an unsharp mask is applied by a predetermined 
percentage having a predetermined radius and/or threshold, for example, by 1 0% having 

15 a radius of 1 and threshold of 0 in an operation 1 68. 

If the resized image is not a thumbnail size image in the operation 164, 
i.e. "No", or if the image is not desired to be resized in the operation 160, i.e. "No", then 
the operation flow 126 determines whether an unsharp mask should be applied based on 
analysis of the image histogram statistics in an operation 170. If an unsharp mask 

20 should be applied, i.e." Yes", the operation flow 126 determines whether the input image 
is an uncompressed image, such as a BMP or TIFF image, or the input image is a 
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compressed image, such as a JPEG image in operations 172, 174. If the input image is a 
BMP or TIFF image, then the operation flow 126 determines whether the largest 
dimension of the input image is between a range, for example, between but not 
including 128 and 450 pixels in an operation 176. If the largest dimension of the input 
5 image is within 128-450 pixel range, i.e. "Yes", an unsharp mask is applied by a 

predetermined percentage in an operation 178, for example, by 30%, which has a radius 
and threshold based on the image analysis. Next, the operation flow 126 goes to 
determine whether an image post-processing is desired in an operation 182. 

If the largest dimension of the input image is not within 128-450 pixel 
10 range in the operation 176, i.e. "No", or if the input image is a JPEG, BMP, or TIFF 

image from the operations 172 and 174, then an unsharp mask is applied in an operation 
1 80 by a percentage, radius, and threshold based on the image analysis. Next, the 
operation flow 126 goes to determine whether an image post-processing is desired in an 
operation 182. 

15 If the user desires to post-process the image in the operation 182, i.e. 

"Yes", the brightness, contrast, and saturation percentage of the image may be adjusted 
by the user's definition in operations 184, 186, and 188, respectively. Further, an 
unsharp mask may be applied to the image by post-processing mask percentage, for 
example, having a radius equal to 1 and a threshold equal to 1 in an operation 190. The 

20 post-processing mask percentage can also be defined by the user. It is appreciated that 
the sequence or order of the operations 184-190 can be varied within the scope of the 
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present invention. 

If the post-processing is not desired in the operation 182, i.e. "No" 5 then 
the operation flow 126 may determine whether a trial image or a preview of an output 
image is desired in an operation 192. If a trial image is desired, i.e. "Yes", then a logo, 
5 such as a company's logo, e>g. VisualGold™ logo, may be embossed in the trial image 
in an operation 194. Next, the operation flow 126 goes to determine whether an image 
output is a JPEG image in an operation 196. 

If the trial image is not desired in the operation 194, then the operation 
flow 126 goes to determine whether an image output is a JPEG image in the operation 
10 196. Also, since each of the processing steps is separable from each other, the operation 
flow 126 can be interrupted at any time. Once interrupted, the image at the time of 
interruption is automatically saved for review and further processing. 

If the image output is a JPEG image in the operation 196, i.e. "Yes", then 
the YUV color settings and Q-factor for the JPEG image are set in an operation 198. 
15 The YUV color settings and Q-factor are described later in details. Next, the image 

output is saved to a storage medium, transmitted to a device, or passed to an application, 
etc., in an operation 200. If the image output is not a JPEG image in the operation 196, 
then the operation 198 is bypassed, and the operation flow 126 goes to an operation 200 
to save the image output to a storage medium, or to transmit the image output to a 
20 device, or to pass the image output to another application, etc. 

When a compression is desired to drive an output file to a specific file 
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size, the operation flow 126 further includes an operation 201 to determine YUV 
settings and Q-factor. 

Then, the operation flow 126 goes to determine whether additional image 
outputs of the same input image are desired in an operation 202. If additional image 
5 outputs are not desired, the image processing operation flow 126 is terminated. If 
additional image outputs are desired, the image processing operation flow 126 goes 
back to the operation 160 to determine whether the additional image needs to be resized 
and continues the steps as described above. It is noted that the additional output images 
are generated without re-analyzing, re-classifying, or re-enhancing/re-compressing the 
10 input image. 

It is appreciated that additional operations can be implemented within the 
scope of the present invention. For example, the operation flow 126 may include 
operations such that the processed image can be sampled and compared to the input 
image to allow a user to adjust the processing parameters to achieve the desired output 

15 images. Accordingly, the image processing method may include steps of establishing 
the need for further processing, and providing successive filter settings for each 
consecutive filter pass by a measurable parameter or a change between input image and 
processed image, and its approximation to a default or user defined parameter. It is 
noted that a database containing all process information unique to the image 

20 characteristics upon which the process draws information for further processing can be 
provided. Further, it is noted that an archive of pre-processing and post-processing 
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settings for all images previously processed can be provided. All images previously are 
processed for a given set of user defined characteristics upon which the process draws 
information for all future image processing to reduce process iterations for desired 
results. 

5 Exemplary image analysis, classification, and enhancement/compression 

processes are described herewith in details. Generally, there are three main steps. The 
first step is to analyze an image's histogram, e.g. luminosity histogram, to derive the 
three statistical functions, the Weighted Mean, the Half Value Position, and the 
Weighted Standard Deviation. The second step is to classify the image by its statistical 

10 functions which are compared against set parameters for each class of images. The 
classes of images are derived from experimental data. The experimental data can be a 
collection of human experienced/perceptive data about images from which tables and a 
database is built. The third step is to apply a set of predetermined changes to the image 
based upon its class. The changes for each class vary but generally include brightness, 

15 contrast, saturation, curve, and unsharp mask. It is appreciated that the changes may be 
applied in a specific degree and order, and that the application of the changes may also 
take into account for the compression that may be applied after this process and/or other 
processes such as resizing of an image. 

I. Analysis of An Input Image 

20 In general, an input image is converted to a standard format, for example, 

a DIB format, to improve visual qualities of the input image. Each image is then 
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analyzed for its unique luminosity and color characteristics/attributes, classified, and 
enhanced to improve its visual qualities. The method includes all interfaces and logic to 
operate in a dynamic environment or a static environment as part of an application or as 
a stand-alone utility. The input image can be a pre-compressed image via a 
5 compression algorithm, such as JPEG, Wavelet, and Fractal, etc. The input image can 
also be an uncompressed image, such as a BMP or TIFF image. 

Analysis of both statistical and visual qualities of the images may 
produce the following results. For example, images can be divided into classes based 
upon distinctions in images' luminosity histogram: a) the Weighted Mean (WM); b) the 
y 10 Weighted Standard Deviation (WSD); and c) the direction and amount of separation 

H between the Weighted Mean and the Half Value Position (HVP), etc. 

M= By analyzing each component, the following results may occur: a) the 

+= higher the Weighted Mean, the lighter the image color; it is noted that this may be the 

main determining criteria for image classification; b) the higher the Standard Deviation, 
m 1 5 the higher the contrast of the image; c) depending on the Weighted Mean and Standard 

p Deviation, the difference between the Weighted Mean and the Half Value Position 

determines the exposure of an image. For example, an image with a higher Standard 
Deviation, a greater difference in Half Value Position, and a lesser Weighted Mean, 
results in an over-exposed image. While images that possess these values within a 
20 certain constraint are considered as images of "normal" exposure. This generally forms 
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the basis for the analysis, classification, and identification of the required enhancements 
to be performed on the image. 

The analysis of the image histogram is derived from the three statistical 
functions as defined below: 



255 



1 ) Weighted Mean: 



/=0 



255 



>0 



2) Weighted Standard Deviation: 
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1 0 Where p n is defined as the position or ordinal values of the histogram, 

and a n is defined as the amplitude of the pixels at each n th ordinal. 

3) Half Value Position: This is defined as the ordinal in the Histogram where all 
the pixels below that ordinal, sum (left to right) to at least half the pixels of the image. 
15 It is appreciated that the definitions of the above three functions may be 

varied within the scope of the present invention. 
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II. Classification and Enhancement Application Based on Classification 
The results of the analysis of the image histogram are used to classify 
and enhance the image. 

TABLE 1 below defines a rule set for classifying an image and an 
5 enhancement rule set for each classification of images. It is appreciated that TABLE 1 
is an exemplary illustration of qualitative analysis and can be varied within the scope of 
the present invention. Therefore, TABLE 1 is considered as one embodiment of the 
present invention, and the invention is not limited thereby. 



10 KEYS FOR TABLE 1 





WM= Weighted Mean 


B = Brightness 




HV = Half Value Position 


C = Contrast 




WSD= Weighted Standard Deviation 


Sat = Saturation 




CRV = curves 


Mask = BMP/TIFF Unsharp Mask 



g TABLE 1 



Operation Identification 
Shown in Figs. 6A-6C 


Classification Rules 


Enhancement Rules* 


A 


WM<30 


Mask 


Dl 


30<WM<100 

WSD<40 

|WM-HV|<15 


2B, 4C, 2Sat 
20% Mask 


D2 


30<WM<60 

WSD<40 
|WM-HV|>15 


CRV1 
-2B, 2Sat 
20% Mask 


29 
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Operation Identification 
Shown in Figs. 6A-6C 


Classification Rules 


Enhancement Rules* 


D3 


60<WM<90 

WSD<40 
|WM-HV|>15 


2B, 4C, 2Sat 
20% Mask 


D 


90<WM<100 

WSD<40 
|WM-HV|>15 


CRV1 
-2B, 2Sat 
20% Mask 


C2 


30<WM<50 
WSD>60 


CRV2 
30% Mask 


CI 


5(teWM<80 
WSD>60 


CRV3 

-5B, -3C, 5Sat 
30% Mask 


c 


80*WM<100 
WSD>60 


3B, -2C, 3 Sat 
30% Mask 


E 


30^WM<60 

40<WSD<60 

|WM-HV|<10 


3B,4C,7Sat 
30% Mask 


G 


60<WM<80 

40<WSD<60 

|WM-HV|<10 


CRV4 
3B,4C,2Sat 
30% Mask 


J 


80<WM<100 
40<WSD<60 
|WM-HV|<10 


CRV5 
2C,4Sat 
30% Mask 


F 


30<WM<60 

40<WSD<60 

WM-HV>10 


CRV6 
4B 5 2C 
30% Mask 


H 


60<WM<80 

40<WSD<60 

WM-HV>10 


CRV7 
-2B, 5Sat 
30% Mask 


K 


80<WM<100 
40<WSD<60 
WM-HV>10 


CRV8 
-2B, 2C 
30% Mask 


I 


60<WM<80 

40<WSD<60 
HV-WM>10 


CRV7 
6B, 5Sat 
30% Mask 
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Operation Identification 
Shown in Figs. 6A-6C 


Classification Rules 


Enhancement Rules* 


L 


8(kWM<100 
40^WSD<60 
HV-WM>10 


CRV7 

6B, 2C, 5 Sat 
30% Mask 


A4 


WM>220 


30% Mask 


Al 


200<WM<220 
WSD>60 


30% Mask 


A2 


200<WM<220 
WSD<40 


3C, lOSat 
20% Mask 


A3 


200<WM<220 
40<WSD<60 


CRV8 
30% Mask 


X 


150<WM<175 

WSD>60 

|WM-HV|<15 


IB, -3C, 3Sat 
30% Mask 


XI 


175<WM<200 

WSD>60 
|WM-HV|<15 


CRV9 
2C, 3 Sat 
30% Mask 


W 


150<WM<175 

WSD>60 

|WM-HV|>15 


CRV10 
3B, 2C, 6Sat 
30% Mask 


Wl 


175<WM<200 

WSD>60 

|WM-HV|>15 


CRV10 
4B, 4Sat 
30% Mask 


Y 


150<WM<200 
WSD<40 


-IB, 4C 
30% Mask 


Z2 


150<WM<200 

40<WSD<60 
|WM-HV|>15 


CRVll 
2C, 5 Sat 
30% Mask 


Z 


150<WM<175 

40<WSD<60 
1 WM-HV|<15 


2C, 4Sat 
22% Mask 


Zl 


175<WM<200 

40<WSD<60 
|WM-HV|<15 


-2B, 3 Sat 
30% Mask 
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Operation Identification 
Shown in Figs. 6A-6C 


Classification Rules 


Enhancement Rules* 


M 


100<WM<120 
45<WSD<55 
30% Mask 


CRV12 
2B, 5Sat 
30% Mask 


N 


120<WM<130 
45<WSD<55 


CRV12 
IB, 3Sat 
30% Mask 


0 


130<WM<150 
45<WSD<55 


30% Mask 


P 


100<WM<150 
WSD<40 


CRV13 
-4B, -3Sat 
20% Mask 


Q 


100<WM<150 
40<WSD<45 


3C, 3 Sat 
20% Mask 


Rl 


100<WM<130 
55<WSD<60 


30% Mask 


R 


130<WM<150 
55<WSD<60 


CRV12 
3Sat 

30% Mask 


VI 


100<WM<130 

WSD>70 

|WM-HV|<8 


CRV14 
-lB,4Sat 
30% Mask 


V 


130<WM<150 

WSD>70 

|WM-HV|<8 


CRV15 
-3C, 7Sat 
30% Mask 


SI 


100<WM<130 

WSD>60 

|WM-HV|<15 


CRV16 
-2B, 1C, 2Sat 
30% Mask 


s 


130<WM<150 

WSD>60 
|WM-HV|<15 


CRV17 
IB, -3Sat 
30% Mask 


TP 

T 


100<WM<130 

WSD>60 

WM-HV>15 


CRV18 
1C, oSat 
30% Mask 


Tl 


130<WM<150 

WSD>60 

HV-WM>15 


CRV19 
-lB,2Sat 
30% Mask 
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Operation Identification 


Classification Rules 


Enhancement Rules* 


Shown in Figs. 6A-6C 








100<WM<130 


CRV20 


T T 
U 


WSD>6(J 


-4B, 5 Sat 




HV-WM>15 


30% Mask 




130<WM<150 


CRV21 


Ul 


WSD>60 


-2B, 2Sat 




WM-HV>15 


30% Mask 



Figs. 6A-6C illustrate a flow diagram of image classification/ 
enhancement operations in one embodiment of an image processing method in 
accordance with the principles of the present invention. The image enhancement 
5 operations or rules shown in Figs. 6A-6C correspond to TABLE 1 . For example, an 
image having the statistics in TABLE 1 A below would apply image enhancement rule 
M G" in Fig. 6A 5 following operational blocks 204-222. The order in which the 
enhancement functions are specified in the rule set is one implementation of present 
invention. It is appreciated that the other orders can be used without departing from the 
10 present invention. 



TABLE 1A 



Weighted Mean 


Weighted Standard Deviation 


Half Value Position 


66.3 


45.9 


72 



It is appreciated that other classification/enhancement rules can be used 
without departing from the scope of the invention. It is also appreciated that the above 
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classification/enhancement rules may be implemented in an algorithm format within the 
scope of the invention. 

It is appreciated that the other image processing operations such as 
sharpening, masking, etc, can be used within the scope of the present invention. It is 
5 also appreciated that the degree of adjustment in brightness, contrast, saturation, or the 
percentage or amount of curve, unsharp mask, etc., can be varied without departing 
from the scope of the present invention. 

Exemplary image processing filters or tools that can be used in the 
present invention are Brightness, Contrast, Saturation, Curves, Unsharp Mark, Preserve 
10 White, Resizing, etc. 

It is appreciated that the image processing filters are not limited to the 
above, and that the other filters can be used, such as color balance, tone balance, and/or 
hue, cropping, etc. 

Figs. 7A-7C illustrate exemplary curves. As described above, curves 
1 5 allow enhancement of luminosity characteristics in a given area of an image when 

determined by the classification process. The curves enhancement function is defined as 
a re-mapping of luminosity or density values versus exposure. The benefit of this 
function occurs when an image needs a shift in luminosity for specific portions in the 
image. For example, images with shadows are able to shift those shadows to a higher 
20 luminosity while the entire image is not shifted or made lighter. The way of achieving 
this technique involves a mapping of luminosity values which are valued from 0-255 to 
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new luminosity values in that range. The curve applied to an image is determined by 
the classification of the image. Three exemplary curves applied to map the luminosity 
values of an input image are shown in Figs. 7A-7C, respectively. In Figs. 7A-7C, the 
line starts in the lower left, i.e. at black color (luminosity level of 0) and goes to the 
5 upper right, i.e. at white color (luminosity level of 255). In Fig. 7 A, a curve 224 

demonstrates no alteration or mapping to an image. For example, an input luminosity 
level of 143 remains at 143. In Fig. 7B, a curve 226 is applied to brighten the entire 
image. For example, an input luminosity level of 143 is brightened to luminosity level 
of 184. In Fig. 7C, a curve 228 is applied to darken the over-all image. For example, an 

10 input luminosity level of 143 is darkened to luminosity level of 109. It is noted that in 
Figs. 7B and 7C, an entire image is brightened or darkened. It is appreciated that a 
curve can be applied to brighten or darken a certain portion of the image. It is also 
appreciated that other curves can be used within the scope of the invention. 

To further illustrate a curve in a table format, TABLE 2 provides one 

1 5 exemplary curve for luminosity mapping. 

TABLE 2: Curves Table Example 



Curves Table Example 



255 


254 


253 


252 


251 


250 


249 


248 


247 


255 


253 


251 


249 


248 


246 


244 


242 


241 




















246 


245 


244 


243 


242 


241 


240 


239 


238 


239 


237 


235 


234 


232 


231 


229 


228 


226 




















237 


236 


235 


234 


233 


232 


231 


230 


229 


225 


223 


222 


221 


220 


219 


218 


217 


216 
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Curves Table Example 



22o 


22 / 


ooa 
zzo 


OO c 
225 


OO/I 

224 


ooo 
223 


ooo 
ILL 


OO 1 

221 


OO A 

220 


21 J 


O 1 /I 

214 


0 1 1 

213 


O 1 o 

212 


O 1 1 

211 


O 1 A 

210 


OAO 

2oy 


OAO 

208 


OAO 

ZUl 




















010 

219 


O 1 0 

218 


o 1 o 
zl / 


O 1 A 

zlo 


O 1 c 

215 


O 1 /I 

214 


O 1 o 

213 


O 1 o 

212 


O 1 1 

211 


OAO* 

207 


OAA 

206 


O AC 

205 


OAC 

205 


OA/1 

204 


O AO 

203 


OAO 

203 


OAO 

202 


OA 1 

201 




















O 1 A 

210 


O AO 

zuy 


OAO 

208 


o f\n 
Zvl 


OAA 

206 


OAC 

205 


OA/1 

204 


OAO 

203 


OAO 

202 


O A1 

201 


OAA 

200 


OAA 

200 


1 oo 

iyy 


1 QQ 

iyy 


1 oo 
19o 


1 oo 

iy8 


1 AO 

197 


1 AO 

197 




















OA1 

201 


OAA 

200 


1 on 

iyy 


1 oo 

iy8 


1 AO 

iy7 


1 OA 

iy6 


1 oc 

iy5 


1 A/1 

194 


1 AO 

193 


1 AA 

196 


1 AA 

iyo 


1 AC 

iyj 


1 AC 

iyj 


1 A/1 

iy4 


1 C\A 

iy4 


1 AO 

iy3 


1 AO 

193 


1 AO 

192 




















1 no 
192 


1 A 1 

iy i 


1 OA 

iyu 


1 oo 

isy 


1 oo 
loo 


1 oo 
18 / 


1 OA 

186 


1 oc 
185 


1 QA 

184 


1 AO 

192 


1 n 1 

iyi 


1 OA 

iyu 


1 OA 

isy 


1 OA 

isy 


1 oo 
loo 


1 oo 
lo/ 


1 OA 

186 


1 OA 

186 




















183 


1 oo 

182 


1 O 1 

181 


1 OA 

180 


1 oa 

179 


1 no 
178 


1 nn 

ill 


1 oa 

lib 


1 OC 

175 


1 OC 

185 


1 0/1 

184 


1 01 

183 


1 OO 

183 


1 oo 
182 


1 O 1 

lol 


1 OA 

180 


1 OA 

180 


1 oo 
1 /9 




















1 1 A 
1 /4 


1 HI 
1 /J 


1 oo 
1 11 


1 O 1 
1/1 


1 OA 
1 /O 


1 AO 

ioy 


1 AO 

loo 


1 AO 

lo/ 


1 AA 

166 


1 oo 
1 /8 


ill 


1 oa 
1 /O 


1 oc 
1 / J 


1 1A 

1 /4 


1 oo 

1 15 


1 OO 

1 11 


1 01 

1 /I 


1 OA 
1 /O 




















1 AC 

165 


1 A/1 

164 


1 AO 

163 


1 AO 

162 


1 A 1 

lol 


1 AA 

160 


1 CO 

1 5y 


1 CO 

Ijo 


1 CO 

15 / 


1 ao 

169 


1 AO 

loo 


1 AO 

lol 


1 aa 
loo 


1 AC 

165 


1 A/1 

164 


1 AO 

163 


1 AO 

162 


1 AO 

162 




















1 CA 

156 


1 Cf 

155 


1 C /I 

154 


1 CO 

153 


1 CO 

152 


1 C 1 

151 


1 CA 

150 


1 A A 

i4y 


1 A O 

148 


1 AA 

lot) 


1 CA 

i5y 


1 CO 

158 


1 CO* 

157 


1 CA 

156 


1 cc 

155 


1 C/1 

154 


1 CO 

153 


1 CO 

152 




















1 /IT 

147 


1 A A 

146 


1 A C 

145 


1 /I A 

144 


143 


1 /ii 
142 


i/ii 
141 


1 A A 
140 


1 O A 

139 


151 


1 A A 

i4y 


1 /I O 

148 


"\ AH 

147 


1 A £L 

146 


1 A C 

145 


144 


1 A O 

143 


1 A O 

142 




















138 


137 


136 


1 o c 

135 


1 1 A 

134 


1 

133 


1 oo 
132 


1 O 1 

131 


1 OA 

130 


141 


1 /I A 

14U 


138 


137 


1 0 A 

136 


1 o c 
135 


10/1 

134 


1 O 0 

133 


1 oo 
132 




















1 oo 
lzy 


1 oo 
Izo 


1 oo 

ill 


1 OA 

izo 


1 O'n 

IZJ 


1 OA 
1Z4 


1 01 
IZJ 


1 00 
Izz 


1 0 1 
lz 1 


131 


130 


129 


127 


126 


125 


124 


123 


122 




















120 


119 


118 


117 


116 


115 


114 


113 


112 


121 


120 


119 


117 


116 


115 


114 


113 


112 
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Curves Table Example 



111 
111 


1 1 A 

1 1U 


1 AO 

ioy 


1 AO 

lOo 


1 A7 
1U/ 


1 AA 

100 


1 AC 

105 


1 A/1 

104 


1 AO 

103 


111 

111 


1 1U 


1 AO 

ioy 


1 AO 
10/ 


1 AA 

lOo 


1 AC 

105 


1 A/l 

104 


1 AO. 

103 


1 AO 

102 




















1 AO 

102 


1 A 1 
101 


1 AA 
1UU 


no 

yy 


oo 

ys 


OO 

y 1 


OA 

y6 


AC 

y5 


O/i 

y4 


101 


1 AA 
100 


yy 


y© 


y / 


OA 

y6 


oc 

y5 


C\A 

y4 


oo 

y3 




















AT 

yj 


go 
yl 


y 1 


OA 

yu 
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oy 


00 
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OO 
0/ 


OA 

06 


0 c 
85 


oo 
yZ 


0 1 

yi 


QA 

y\) 


QQ 
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00 
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OO 
O / 


OA 

06 


o c 
o5 


OA 

84 




















QA 

o4 


o3 


oo 

82 


0 1 

ol 


OA 

80 


OO 

Iy 


OO 

/o 


HH 

1 1 


OA 

/6 


00 


82 


0 1 

ol 


OA 

80 


TO 

iy 


OO 

/o 


/ / 


OA 
10 


oc 

75 




















75 


74 


OO 

73 


*70 

12 


H 1 

71 


Hf\ 

70 


AA 

by 


AO 

68 


67 


HA 

74 


73 


72 


H 1 

71 


H 1 

71 


OA 

70 


6y 


no 

68 


/TO 

68 




















A A 

66 


AC 

65 


A /I 

64 


AO 

63 


62 


A 1 

61 


AA 

60 


C A 

5y 


58 


67 


AA 
66 


65 


65 


CA 

64 


ao 
63 


ao 
62 


AO 

62 


61 




















CO 


CA 

56 


55 


C/1 

54 


ci 
53 


CO 

52 


51 


CA 

50 


/l Q 

4y 


aa 
60 


cg 
5y 


co 

5y 


CO 

5o 


5 / 


C A 

5o 


CA 

56 


55 


C/l 

54 




















4o 


A O 

4/ 


A A 

4o 


/i c 

45 


44 


43 


A O 

42 


A 1 

41 


/l A 

40 


co 


CO 

53 


52 


51 


5(J 


C A 

50 


A O 

4y 


yl 0 

4o 


A o 
4/ 
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38 
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37 


O A 
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o c 
35 
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o 0 

33 


0 o 

32 


O 1 

31 


/I A 

46 


/i a 
46 


/I c 

45 


44 


A 0 

43 


/lO 

42 


/I o 

42 


A 1 

41 


/I A 

40 




















i a 
3U 


2y 
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26 
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Further, an unsharp mask enhances an image by making it sharper 
without accentuating small imperfections in an image. Thus, an image gains more 
details and clarity while preserving visual continuity. The unsharp mask percentage 
applied to an image is dependent upon an input image file type and is handled 
5 differently for a compressed image, such as a JPEG image, from an uncompressed 
image, such as a BMP or TIFF image. 

Pre-compression Enhancement Process for Images that are Resized 

The image processing system in accordance with the present invention 
addresses issues of image quality degradation resulting from either resizing of an image 
10 or artifacts introduced in the process of compressing a previously compressed image, or 
a combination of both processes. 

Post Resizing Enhancement Process 

High quality digital source images, such as BMP and TIFF files that have 
not been previously compressed, may need to be resized. If the image is resized by 

1 5 dividing the pixel dimensions by some number that, when divided into the number of 
pixels leaves no fraction, then the sharpness of the image is not significantly degraded 
in the process. For example, reducing 400 pixels to 200 pixels or 900 pixels to 300 
pixels would not greatly alter the apparent sharpness of the image. If the image is 
resized by another factor such as 400 pixels to 299 pixels, significant interpolation of 

20 the image occurs resulting in the loss of image sharpness or clarity. The loss of 

sharpness generated from this interpolation process can be significantly regained by 
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increasing the edge definition of the image content through application of an unsharp 
mask filter. The percentage strength of the mask can be altered to optimize the amount 
of edge enhancement applied based on the ratio of reduction from the original image, 
the absolute physical dimensions of the reduced image, the amount of interpolation 
5 required to achieve the desired resized dimensions, the type of interpolation algorithm 
used, or a combination of all of the above factors. 

TABLE 3 below defines an exemplary unsharp mask applied to a resized 
image, which is not previously compressed, based on the image's longest axis 
dimension. 

10 

TABLE 3 (BMP & TIFF unsharp mask) 



MASK TABLE FOR BMP & TIFF IMAGES 


DPI 


Mask % to be applied 


Oto 128 


30 


128 to 450 


35 


450+ 


30 



1 5 The enhancement process also considers the special case of thumbnails, 

e.g. images of approximately 128 pixels or less on the longest axis, wherein the 
information defining the image is significantly reduced. Image sharpness of thumbnail- 
sized images is greatly improved by applying an additional percentage of unsharp mask, 
and a small increase in contrast, brightness, and, for color images, saturation. These 
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filters allow the image to retain high visual qualities while attaining higher degrees of 
compression than when not applying such filters. 

It is appreciated that the enhancement process is not limited to the special 
case of thumbnails, and that the enhancement process can be used in other resizing 
5 applications within the scope of the present invention. 

Enhancement Process for Resizing Previously Compressed Images 
The rules that govern usage of an unsharp mask applied to an input 
image previously compressed, such as a JPEG image, require different unsharp mask 
optimization rules from those applied to images that have not been previously 
10 compressed. 

The percent of unsharp mask to be applied in the resizing of a previously 
compressed JPEG image requires compensating for the variables described as optimal 
for uncompressed images and, in most cases, the percentage of the unsharp mask is then 
reduced from that uncompressed optimal setting so as not to accentuate the artifacts 

1 5 introduced in the initial compression process. 

Determining the factor to reduce the amount of mask for a given JPEG 
file can be calculated in several ways. In one method, the ratio of total pixel count of 
the DIB (Device Independent Bitmap) is compared with the original compressed JPEG 
image file size in kilobytes. This ratio is used as criteria for exemplary TABLE 4 below 

20 to obtain the appropriate unsharp mask percentage to be applied to the image. 
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• # 

TABLE 4 



MASK TABLE FOR JPEG IMAGES 



Ratio is the total pixels of an image divided by the file 

size (K) 



Ratio 


Mask % to be applied 


0-1500 


42 


1501-1900 


36 


1901-2300 


26 


2301-2600 


23 


2601-3500 


20 


3501-4500 


17 


4501-6000 


15 


6001-9000 


10 


9001-12000 


7 


12001+ 


5 



The application of the use of an unsharp mask in this fashion enhances 
edge definition and, therefore, apparent sharpness to the image without adding 
5 significantly to the picture's high frequency content. Since high frequency limits how 
effectively a compression algorithm can be in reducing file size, images processed in 
this manner can be compressed further, with less visible artifacts, high apparent image 
sharpness, and greatly reduced file size. 
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The pre-compression, post resizing enhancement is applied automatically 
without operator's intervention. The algorithm can also be applied in a networked or 
server-based environment where no human intervention is possible. 



5 Enhancement Process for Reducing Apparent Artifacts in Images 

An image may have had artifacts introduced into the picture or image 
through a scanning process, compression algorithm, color reduction such as experienced 
in a GIF image for the Internet or by scanning a printed page including half-tone dot 
patterns. The present invention reduces these visible artifacts and allows for the 
10 creation of a second-generation image that can be resized and compressed with 

improved edge definition and reduced artifacts as compared with the source image. 

The process utilizes a "Blur 55 filter that tends to "smear/smudge" the 
blocking generated as a result of the compression or similar to a blocking of dot patterns 
created by scanned images or GIF. Because the "Blur 55 filter reduces the appearance of 
1 5 the blocking throughout the whole picture, edge definition of the image degrades and 
thus must be restored. The application of unsharp mask filter is then applied in multiple 
iterations in same or varying amounts (e.g. 15%/15%/15%) whereupon the image's 
intended edges are redefined with the artifacts remaining less evident. 

It is appreciated that other filters may be applied to pre-compression, 
20 post-resizing enhancing of images without departing from the scope of the present 

invention. It is further appreciated that the degree of application of the filters applied, 
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e.g. "Blur", "unsharp mask", etc., can be varied without departing from the scope of the 
present invention. 

III. Compression of the Output Image 

The image processing system may include a user interface that allows a 
5 user to compress an enhanced image. As an example, an enhanced JPEG image can be 
further compressed by setting YUV settings and Q-factor, as well as a unique file name 
for each output image when applied to a batch of images. 

It is appreciated to those skilled in the art that the Q-Factor relates to a 
term that represents the quality versus compression ratio used in saving an image as a 
10 JPEG file. It is also appreciated to those skilled in the art that a YUV Color Difference 
Coordinate System relates to a color coordinate system that represents RGB colors in 
terms of the luminosity Y and two difference colors. The Y tristimulus value represents 
luminosity, while the U and V variables represent a percentage of luminosity less Blue 
and Red, respectively. It is appreciated that the compression applied is not limited to 
1 5 the compressed JPEG image, without departing from the scope of the present invention. 

IV. Compression of an Image to a Target File Size 

The image processing system includes a user interface that allows a user 
to drive an input image to an approximate file size. In one embodiment of the present 
20 invention, this may be accomplished with a series of tables. This feature involves 

saving an input image in a memory or buffer as a 30 Q-factor/4:4:4 YUV setting. The 

43 

Attorney Docket No. 13095.1-US-U1 




file size (in kilobytes) is then compared against a file size, such as a BMP file size, of an 
input image to obtain a percentage. This percentage is referenced and used to map to 
the correct table. An example of these tables is given in a JPEG Compression 
Approximation in TABLE 5. Of course, those skilled in the art appreciate that many 
5 examples of such tables may be provided, and that TABLE 5 is but one of such 

examples. Accordingly, the invention is not limited to such examples as others may be 
provided without departing from the scope and spirit of the invention. 

TABLE 5 





^Factor 

' 2 « 

\ 


^QFactor* 

l f t - ■■■■flip 




factor 

is ^ 


QFactor 


QFactor 


|JFadp : | 


QFactor 




411 


2.47 


1.98 


1.65 


1.36 


1.2 


1.07 


1 


0 


0.856 


422 


2.695 


2.075 


1.675 


1.38 


1.21 


1.075 


1 


0.925 


0.867 


444 


2.92 


2.17 


1.7 


1.4 


1.22 


1.08 


1 


0.93 


0.878 



10 

An exemplary process of compressing an image on a single image input 
basis is as follows: 

1 . Saving the image (enhanced or not) as a 30 Q factor JPEG, 444 
1 5 JPEG to a memory or buffer, recording the file size of this image, and 

using it as a reference. 

2. Multiplying this file size by the factors dependent upon the YUV 
setting chosen by the user. 
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3. Depending upon the file size chosen, the appropriate Q-Factor is 
applied to the image in order to output the image as a JPEG image. 



Accordingly, the user interface allows for various compression and/or 
5 quality change settings. Any known compression algorithm, such as the JPEG 
compression algorithm, can be used within the scope of the invention. In one 
embodiment, the first user option is a series of compression choices that involve either a 
slider bar or a set of numerical options. The user interface allows for image 
compression ranging from, for example, 20 to 60 in Q-Factor while utilizing a 4: 1 : 1 
10 YUV setting. 

The image compression range, for example, from 20 to 60 in Q-Factor 
while utilizing a 4: 1 : 1 YUV setting, is imposed to limit the degradation of images that 
normally occurs beyond a 60 Q-Factor. For example, a 4:1 :1 YUV setting causes a 
need for an additional +5 saturation to compensate for the color change in an image. 

1 5 The user interface also allows for a separate quality choice. This gives the user the 

option to compress an image while still being assured a high quality image. In another 
example, the Q-Factor ranges from 2 to 30 and involves a YUV setting of 4:4:4, which 
may not require any additional saturation. 

The above specification, examples and data provide a complete and 

20 enabling description of the invention. Since many embodiments of the invention can be 
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made without departing from the spirit and scope of the invention, the invention resides 
in the claims hereinafter appended. 
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